14. Obtaining a Gold Standard Quizzes

Obtaining a Gold Standard Quizzes

Obtaining a ground truth

Which of these is not a method for obtaining a ground truth?

SOLUTION: Asking the patient what their diagnosis was

Ground truth v. gold standard

Given these three radiologist labels, set of patient symptoms and clinical history, and biopsy sample, what would be the ground truth for this study if we were labeling for presence or absence of pneumonia?

  • Radiologist 1: pneumonia

  • Radiologist 2: pneumonia

  • Radiologist 3: pneumonia

  • Biopsy: no pneumonia

  • Patient has a clinical history of pneumonia
SOLUTION: No pneumonia

Explanation

If such biopsy data is available, this would really be the 'gold standard' because human radiologists can make mistakes. If biopsy data is not available, though, we'd probably want to create a silver standard using a weighted combo of radiologist labels and their experience levels or just a voting-based label from each of the 3 radiologists' labels for each image.

Next Concept